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Background: The primary objective of this pilot study was to demonstrate reUable adherence 
to a group cognitive behavioral (CBT) therapy protocol when delivered using on-line video 
conferencing as compared with face-to-face deliveiy of group CBT. A secondary aim was to 
show comparability of changes in subject depression inventory scores between on-line and 
face-to-face delivery of group CBT. 

Methods: We screened 3 1 individuals, 1 8 of whom met the criteria for a DSM-IV (Diagnostic 
and Statistical Manual of Mental Disorders, 4th Edition) diagnosis of mood and/or 
anxiety disorder. All qualifying participants had the necessary equipment (computer, webcam, 
Internet) for participation in the study, but could exercise their preference for either the 
on-line or face-to-face format. Eighteen completed the 1 3 weekly session intervention program 
(ten face-to-face; eight video conferencing). We coded adherence to protocol in both 
intervention formats and generated pre-post changes in scores on the Beck Depression Inventory 
Second Edition (BDI-II) for each participant. 

Results: Application of the CBT protocol coding system showed reliable adherence to the 
group CBT intervention protocol in both delivery formats. Similarly, qualitative analysis of 
the themes in group discussion indicated that both groups addressed similar issues. Pre-post 
intervention scores for the BDI-II were comparable across the two delivery formats, with 
60% of participants in each group showing a positive change in BDI-II severity classification 
(eg, from moderate to low symptoms). 

Conclusion: This pilot study demonstrates that group CBT could be delivered in a 
technology-supported environment (on-line video conferencing) and can meet the same professional 
practice standards and outcomes as face-to-face delivery of the intervention program. 
Keywords: psychotherapy, gerontology, mood disorders, computer-based, cognitive behavioral 
therapy 

Introduction 

The primary objective of this pilot study was to demonstrate reliable adherence to 
a group cognitive behavioral (CBT) therapy protocol when delivered using on-line 
video conferencing as compared with face-to-face delivery of group CBT. A secondary 
aim was to show comparability of changes in depression inventory scores between 
on-line and face-to-face delivery of group CBT. There is an increasing need to 
improve access to mental health services for patients with clinical depression, which 
is the most prevalent psychiatric disorder worldwide.' Adults in their 50s and 60s are 
particularly vulnerable to clinical depression and anxiety due to high rates of co- 
occuiTing obesity, cardiovascular disease, and type 2 diabetes.^"^ 

The prevalence of depression escalates in tandem with the increase in incidence of 
chronic disease as people age. In North America, approximately 80% of adults over 
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the age of 60 years have a chronic disease, and of these, 30% 
have three or more chronic conditions.^ A major concern is 
that having a chronic disease exacerbated by the presence 
of depression and/or anxiety resuhs in poor adherence to 
prescribed treatment and consequent deterioration in heaUh 
and overall quality of life. (Katon*). 

Background 

CBT is an evidence-based, time-limited collaborative form 
of psychotherapy delivered individually or in a group 
format.' Group CBT for depression has been shown to be 
effective for adults across the age spectrum, decreasing symp- 
tom levels (eg, low mood, sleep difficulties) and improving 
cognitive function.^"" CBT is particularly appropriate for 
treating depression and anxiety in older adults with com- 
plex medical profiles, and can be used when antidepressant 
drugs are contraindicated or have intolerable side effects. 
Group CBT is an efficacious and cost-effective way of treat- 
ing depression in an aging population that is undertreated 
despite the increasing prevalence of mood disorders in this 
age group. 

In addition, studies have shown consistently that CBT is 
more effective than medication alone for reducing the risk 
of relapse, resulting in treatment efficacy and overall cost- 
effectiveness.^ A group format for providing mental health 
services to adults helps to prevent social isolation, which is 
a risk factor for poorer mental health in adults with limited 
support systems.'^ 

Technology is being used increasingly to provide various 
forms of psychotherapy and counseling. For example, 
telephones, video telephones, and Internet web applica- 
tions are used to support interactions between therapist and 
client/patient. CBT has been provided via the Internet using 
email exchange between patient and therapist in addition to 
providing web-based information about the management of 
depression.'" While technology has been used to provide 
individual CBT, we found no studies of group CBT delivered 
using Internet-based video conferencing, nor any studies 
that compared process and outcomes of video conferencing 
group CBT with those of face-to-face group CBT. The aim 
of this study was to demonstrate that a technology-supported 
form of group CBT would meet the same clinical practice 
standards and achieve outcomes similar to those achieved 
using clinic-based group CBT. 

Materials and methods 

The study received approval from the research ethics 
board of Baycrest, an academic health sciences center in 



Toronto, Canada. The study was implemented in a clinic 
treating adult mood and anxiety disorders. We screened 
3 1 potential participants aged in their 40s to 70s. Participants 
were referred by their physicians. Potential participants 
who wished to participate in the study were contacted, 
informed of the study, and invited to attend a DSM-IV 
{Diagnostic and Statistical Manual of Mental Disorders, 
Fourth Edition)-SCID (Structured Clinical Interview for 
DSM-IV Axis I Disorders) assessment interview and to com- 
plete a baseline study questionnaire. All subjects provided 
their written informed consent. 

Sample 

Study participants were included if they met the following 
criteria: DSM-IV diagnosis of a mood, anxiety, or adjust- 
ment disorder; absence of a diagnosis of substance abuse or 
psychosis; absence of active suicidal ideation; agreement 
to remain on stable doses of any prescribed psychotropic 
medication for the duration of the study; and access to a 
computer, webcam, and the Internet. Eighteen participants 
met the study criteria. 

Procedures 

We invited eligible participants to choose the intervention 
format that they would feel most comfortable using for 
participation in group psychotherapy. Eight chose the on-line 
format and the remaining ten chose the face-to-face format. In 
both formats, the sessions were videoed and archived for sub- 
sequent analysis. Both interventions consisted of 13 weekly 
one -hour sessions of group CBT. The CBT group protocol 
was followed in both formats: the first 2 weeks of the 
intervention focused on socializing participants into the 
CBT model and developing group cohesion; weeks cen- 
tered on learning the basic behavioral interventions 
(eg, relaxation training and rating of mood) ; weeks 5- 1 0 focused 
on cognitive and behavioral strategies for coping with stress, 
anxiety, and depression; and weeks 1 1-13 addressed termi- 
nation of treatment, consolidation of gains, and training in 
relapse prevention. Both the on-line and face-to-face ses- 
sions were videoed and archived for subsequent analysis. 
The therapist was a trained and experienced CBT psycho- 
therapist; however, supervision was provided by an expert 
CBT trainer to ensure reliable adherence to protocol in 
both formats. The clinical supervisor was the first author of 
this study, and is a PhD clinical psychologist with 1 0 years 
of professional experience (8 years heading a CBT 
service for mood and anxiety disorders at Baycrest, 
Toronto, Canada). 
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Technology platform 

Internet-based video conferencing group CBT was delivered 
using a password-protected web platform, ie, Caring for Me 
(CFMO) which was developed and evaluated in previous 
studies.'^"" The CFM website includes several features: 
an email component allowing participants to communicate 
with each other external to the group meetings; an asynchro- 
nous threaded discussion forum for exchanging thoughts; 
a video conferencing link for group meetings; and a resources 
link that provides an information handbook on depression and 
its diagnosis and treatment; CBT task documents uploaded 
for discussion during video conferencing treatment ses- 
sions; and relevant URLs for accessing reliable information 
about depression and its management. Website navigation 
is supported by a computer training manual distributed to all 
participants. All participants were provided with technology 
support as needed throughout the study by the project coor- 
dinator. During the sessions, all participants and therapist 
could see, hear, and interact with each other in real time. The 
participants appeared around the perimeter of the screen with 
the therapist in the center. 

Outcome measure 

The primary outcome measure was the BDI-II {Beck 
Depression Inventory Second Edition),"* a validated instru- 
ment typically used for assessing the level of depression in 
outpatient treatment programs. The BDI-II was completed 
at baseline and at 3-month follow-up. BDI-II category 
cutoffs were as follows: 0-13, minimal depression; 14-19, 
mild depression; 20-28, moderate depression; and 29-63, 
severe depression. Higher total scores indicate more severe 
symptoms of depression. 

Data analysis 

The aim of the data analysis was four-fold: to examine reliable 
adherence to the CBT intervention protocol using each for- 
mat; to examine differences, if any, in discussion themes 
by phase of therapy within each format; to examine within- 
subject pre-post changes in score on the BDI-II; and describe 
participants' perceptions of using technology to access a 
health care service versus traditional in-clinic services. 

Treatment reliability and validity 

A standardized coding system rating levels of adherence to 
intervention strategies based on the CBT intervention manual 
was used,'' for example, adherence coding related to the stan- 
dard CBT protocol, such as setting the agenda and reviewing 
and assigning homework. Following training and achievement 



of high interrater levels of agreement (80%), two research 
assistants independently coded six sessions randomly selected 
from the pool of recorded sessions across each intervention 
group (face-to-face and video conferencing formats). Note 
that two groups were treated in each format, so six sessions 
were coded for each of four intervention groups. 

Analysis of group session themes 

While the themes discussed in CBT therapy were guided by the 
structure of the therapeutic protocol (cognitive-behavioral), 
it was important to extract the salient themes from each 
intervention format (Internet-based versus clinic-based). 
The methods described by Berg^° and CreswelF' were used 
to perform the qualitative analysis of group process themes 
in each delivery condition. Codes were developed, initial 
themes recorded, and researcher notes provided for careful 
documentation of the salient themes identified within and 
across groups. Two researchers independently engaged in 
this process using the transcriptions for each group to ensure 
accuracy of extracted themes. 

Results 

Eighteen subjects were included in the study (ten chose 
the face-to-face condition and eight the on-line condition). 
Seventy-two percent of the subjects were female, 100% were 
Caucasian, and their average age was 50.8 (range 39-64) years 
for the on-line group and 58.4 (range 40-71) years for the 
face-to-face group (see Table 1 ). On the basis of the DSM-IV 
diagnostic interview data, participants in each intervention 
format did not differ. Three participants withdrew (one in 
the face-to-face group and two in the video conferencing 
group) from the intervention program for reasons unrelated to 
the study intervention. The stated reasons for withdrawal 
were inability or unwillingness to make the time commitment 
for the intervention, scheduling difficulties, and, in one case, 
severity of symptoms, warranting referral for CBT on an 
individual basis (see Table 2). 

With regard to the reliability and validity of treatment, 
interrater agreement on use of the CBT coding system 
was established at the 85%) and 90% levels. Subsequently, 
two early, two middle, and two late sessions in each group 
(face-to-face and video conferencing) were coded and dem- 
onstrated that the CBT intervention was carried out reliably 
in both conditions. 

Qualitative theme analysis was conducted on sessions 3, 
4, 7, 8, 12, and 13. The themes generated were similar bet- 
ween the two group intervention formats. The following key 
themes emerged from the analysis. 
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Table I Patient demographics 





Face-to-face 


Video conferencing 


Participants (n) 


10 


8 


Mean subject age, years (range) 


58.4 (40-71) 


50.8 (39-64) 


Sex (% female) 


90 


50 


Marital status (% married) 


70 


50 


Education (% university/college or higher) 


80 


62.5 


Employment status (% employed) 


40 


87.5 



Notes: Participants who withdrew from the study during various stages of intervention delivery were included in the calculations. Participants who were divorced, separated, 
or had a deceased spouse were considered as not married. 



Consistent struggle with the condition 

Participants discussed the challenge of understanding 
emotions, managing social interactions, developing personal 
coping methods, and focusing on pursuing strategies for change 
(eg, "What happens especially when I get real depressed, I just 
cut myself off from everybody and everything; it doesn't help 
my mood but I feel at those times I have zero energy and zero 
desire to do anything and I feel like I don't belong or fit"). 

Low self-esteem and emotional triggers 

Participants engaged in group discussion about situations 
that exacerbated their negative self-perceptions. Common 
statements included, "I don't deem myself as valuable as 
others", "I don't know how to get along with people", and 
"I am not good enough". 

Relationships 

Stress experienced in relationships with family and friends 
was illustrated by the following statement: "When you end 
up doing more for somebody else, for me it turns into resent- 
ment, a feeling of being used". 

Managing work stress 

It was evident that the work environment was stressful, 
inducing anxiety for all members of the intervention groups 
(eg, "Come Friday I feel relieved that I don't have to come 
to work, I don't have to keep pretending I'm good and that 

Table 2 Participants screened during recruitment 



Round I Round 2 



Participants (n) 


15 


16 


Accepted 


10 


10 


Percent acceptance 


66.7 


62.5 


Withdrawals 


2 


3 


Percent withdrawals 


20 


30 



Notes: Participants who withdrew during various stages of intervention delivery 
were included in the acceptance criteria. Withdrawal indicates the number of parti- 
cipants accepted into the program but who chose to withdraw. 



everything is dandy and all that" and "What I struggle with 
on a daily basis is the anxiety once I'm at work"). 

According to the change in pre-post score on the BDI-II, 
similar proportions of participants in the face-to-face and 
video conference groups demonstrated positive, negative, 
or no change in severity of symptoms. Sixty percent of par- 
ticipants in each group showed improvement in their BDI-II 
score severity (eg, pre-post change from a moderate to low 
BDI-II score), with 20% moving to a more severe category 
and 20% showing no change in category (see Table 3). 

Analysis of 3-month follow-up data 

Despite the fact that all participants were group therapy- 
naive, participants in each group bonded and readily related to 
each other (eg, "When people spoke I could identify the same 
things in myself. It feels like we are not really different"). 
Group members responded positively to specific CBT 
intervention strategies (eg, "I found that this homework was 
really good because the one thing it did was it made me get 
moving"). The response of participants to using technology 
in a clinical context was positive overall (eg, "I'm enjoying 
the group. I think that I'm slowly getting over the technology 
thing and it felt each week more like I was talking to other 
people rather than these images on a computer screen"). 

Impact of technology: 
the therapist perspective 

The same CBT therapist delivered the intervention in both 
formats and found the first on-line group challenging in 
terms of implementing the CBT protocol and ensuring group 
cohesion. Technical glitches due to problems with the video 
conferencing software were frustrating for both the therapist 
and the study participants. For example, some subjects had dif- 
ficulty logging on for a session, and the sound was occasionally 
disrupted during sessions. The study coordinator was always 
on-line during sessions to resolve any technical problems. 

The therapist became more comfortable using the on-line 
CBT strategy after the first session, which was reflected 
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Table 3 Change in BDI-I 


1 severity score 






C 4 ^ ^ A 1 rt 1 Ml 

raCc'tU'IaCtr in — ' W J 




VIQcU in — 3 1 




Improved 


Two significant to low 


Improved 


Two moderate to low 


Improved 


Four moderate to low 


Improved 


One significant to moderate 


Worse 


One low to moderate 


Worse 


One low to moderate 


No change 


Two low to low 


No change 


One significant to significant 


No change 


One significant to significant 








60% showed positive change 




60% showed positive change 




in BDI-II classification 




in BDI-II classification 



Notes: For BDI-II pre-post change, similar proportions of participants in the face-to-face and video conferencing groups showed positive, negative, and no change in severity 
category. Sixty percent of participants in each group improved on their BDI-II score severity category (eg, pre-post change from moderate category to low BDI-II score 
category), 20% moved to a more severe category, and 20% showed no change. BDI-II category cutoffs were as follows; 0-13, minimal depression: 14-19, mild depression; 
20—28, moderate depression; and 29-63, severe depression. Higher total scores indicate more severe depressive symptoms. 
Abbreviation: BDI-II, Beck D&pr&ssion Inventory Second Edition. 



by her easier manner in structuring the CBT protocol and 
emphasizing key elements, such as specific follow-up with 
homework requests. The therapist described the experience 
of facilitating CBT in a technological milieu as a "learning 
curve", which was mastered by addressing the challenges of 
using technology and active clinical supervision. 

Discussion 

The main outcome of this study was that the group CBT 
intervention protocol was adhered to reliably in two formats, 
ie, face-to-face and on-line. Standards of practice were 
upheld for both conditions, and the discussion themes were 
similar between the two formats. Participants who completed 
the 13 -week group CBT protocol had comparable pre-post 
BDI-II scores regardless of treatment format, ie, web video 
conferencing versus clinic-based face-to-face sessions. 
Sixty percent of participants in each group showed a positive 
change in classification of their BDI-II severity (eg, from 
moderate to low symptom levels). Our results are consistent 
with those of other studies of group CBT in older adults 
and, including one study which demonstrated improvement 
similar to patients included in a randomized controlled trial 
of group CBT for depression.^^-^' 

In terms of the mood outcome measures, equivalent results 
across fomiats suggest several possibilities. First, fidelity 
to the CBT model was well established in this study. 
As such, the "active" ingredient of CBT was robust enough 
to negate the impact of any differences in the delivery 
format. In fact, a recent Cochrane review documented 
the effectiveness of therapist-delivered distance CBT 
(by phone, email, video conferencing, live chat, and print) 
for depression and anxiety in adults.^" Second, convenience 
factors associated with the video conferencing format, 
such as evening sessions and remote access to treatment in 
one's own home, may have compensated for the absence 



of in vivo interaction for some participants, especially for 
employed subjects who were unable to schedule treatment 
during working hours. In a review of therapeutic video 
conferencing for chronic physical and psychological dis- 
orders. Steel et aP^ reported that the clinical outcomes of 
video conferencing were comparable with those found with 
in-person delivery. Video conferencing studies have shown 
a high level of patient satisfaction and a positive therapeutic 
alliance. Lastly, from both the therapist and participant per- 
spectives, our results indicate that the video conferencing 
format did not compromise outcomes with regard to mood 
or thematic content of the sessions. Nonetheless, it must 
be acknowledged that freedom to choose the treatment 
modality may have impacted the results of this study. 
Participants may have felt more comfortable and adhered 
more to a personally chosen intervention format as opposed 
to an assigned one. Finally, the sample size of the study was 
small, and this is a clear study limitation. Our results are 
preliminary and need to be interpreted with caution until 
they are replicated in future studies. 

In summary, our pilot study results suggest that group 
therapy delivered by Internet-based video conferencing 
may be suitable for treating depression and anxiety in 
adults. Offering CBT by remote access would constitute 
an achievement of both knowledge translation and clinical 
innovation. Internet-based video CBT group intervention is 
a client-centered, evidence-based, and cost-effective way to 
treat adults with mood and anxiety disorders, who may have 
difficulty accessing services in person due to health concerns, 
frailty, finances, location, or stigma. The limitations of this 
study are its small sample size and the fact that participants 
were able to choose their preferred treatment modality. 
Further studies with randomization of the treatment condition 
and a larger sample size are needed to validate the promising 
findings of the present study. 
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